Presentation system, presentation apparatus, and computer-readable recording medium

ABSTRACT

A presentation system includes the following: a reception unit that receives a start instruction to start a presentation, a detection unit that starts detecting a gesture of a presenter in response to the start instruction, and a control unit that controls an operation for distributing presentation material, based on a detail of detection of the gesture.

This application is based on Japanese Patent Application No. 2011-153031filed on Jul. 11, 2011, the contents of which are hereby incorporated byreference.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to a presentation system and a techniquerelated thereto.

2. Related Art

Presentation apparatuses or the like involve a technique for detectinggestures of a presenter when giving a presentation (see JP2010-205235A).

However, with the technique disclosed in JP 2010-205235A, a period oftime for detecting gestures of a presenter is not clearly shown, and itis unclear as to when the gesture detection is started. For this reason,depending on the situation, there is the possibility that a gesture of apresenter made before the start of a presentation will be erroneouslydetected.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a presentationsystem capable of avoiding a situation in which a gesture made beforethe start of a presentation is erroneously detected, and a techniquerelated thereto.

According to a first aspect of the present invention, a presentationsystem includes a reception unit that receives a start instruction tostart a presentation, a detection unit that starts detecting a gestureof a presenter in response to the start instruction, and a control unitthat controls an operation for distributing presentation material, basedon a detail of detection of the gesture.

According to a second aspect of the present invention, a presentationsystem includes an image capturing apparatus for capturing an image of apresenter, and a presentation apparatus capable of communication withthe image capturing apparatus. The presentation apparatus includes areception unit that receives a start instruction to start apresentation, a detection unit that detects a gesture of the presenterbased on an image captured by the image capturing apparatus, and acontrol unit that controls an operation for distributing presentationmaterial, based on a detail of detection of the gesture. The detectionunit starts detecting the gesture in response to the start instruction.

According to a third aspect of the present invention, a presentationapparatus includes a reception unit that receives a start instruction tostart a presentation, a detection unit that starts detecting a gestureof a presenter in response to the start instruction, and a control unitthat controls an operation for distributing presentation material, basedon a detail of detection of the gesture.

According to a fourth aspect of the present invention, a non-transitorycomputer-readable recording medium records a program for causing acomputer to execute the steps of a) receiving a start instruction tostart a presentation, b) starting detecting a gesture of a presenter inresponse to the start instruction, and c) distributing presentationmaterial based on a detail of detection of the gesture.

These and other objects, features, aspects and advantages of the presentinvention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a conceptual diagram showing an overview of a presentationsystem according to an embodiment.

FIG. 2 is a block diagram showing a schematic configuration of apresentation apparatus.

FIG. 3 shows a screen displayed on a touch screen.

FIG. 4 shows a screen displayed on the touch screen.

FIG. 5 shows a screen displayed on the touch screen.

FIG. 6 shows a screen displayed on the touch screen.

FIG. 7 is a flowchart showing an operation performed by the presentationapparatus.

FIG. 8 is a flowchart showing an operation for distributing presentationmaterial to listener terminals.

FIG. 9 is a flowchart showing an operation for distributing presentationmaterial to a projector.

FIG. 10 shows an image captured by a camera.

FIG. 11 shows an image captured by the camera.

FIG. 12 shows an image captured by the camera.

FIG. 13 shows a comparative image used in matching processing.

FIG. 14 shows a comparative image used in matching processing.

FIG. 15 shows a comparative image used in matching processing.

FIG. 16 shows an image captured by the camera.

FIG. 17 shows an image captured by the camera.

FIG. 18 shows an image captured by the camera.

FIG. 19 shows an image captured by the camera.

FIG. 20 is a conceptual diagram showing a page image displayed on thescreen.

FIG. 21 is a conceptual diagram showing a page image displayed on thescreen.

FIG. 22 is a conceptual diagram showing a page image displayed on thescreen.

FIG. 23 is a conceptual diagram showing a page image displayed on thescreen.

FIG. 24 is a conceptual diagram showing a page image displayed on thescreen.

FIG. 25 is a flowchart showing an operation for distributingpresentation material to the listener terminals.

FIG. 26 is a flowchart showing an operation for distributingpresentation material to the listener terminals.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be described withreference to the drawings.

1. System Configuration

FIG. 1 is a system configuration diagram showing an overview of apresentation system 100. The presentation system 100 is also called a“teleconference system”. The system 100 includes a presentationapparatus 10, a camera 20, a display output apparatus 30, and listenerterminals 70.

The presentation apparatus 10, the camera 20, the display outputapparatus 30, and the listener terminals 70 are connected to one anothervia a network NW and are capable of network communication. Here, thenetwork NW is configured by, for example, a LAN, a WAN, or the Internet.The connection format of each apparatus to the network NW may be a wiredconnection or a wireless connection.

The presentation apparatus 10 is an apparatus that manages material BPto be presented in a presentation (also called “presentation material”)and is also called a “management apparatus”. The presentation apparatus10 stores the presentation material BP and controls an operation fordistributing the presentation material BP to each distributiondestination.

Specifically, as will described later in detail, the presentationapparatus 10 detects a gesture GT of a presenter PT based on imagescaptured by the camera 20 or the like. When the gesture GT has beendetected, the presentation apparatus 10 distributes, for example,display data (specifically, a page image or the like) of thepresentation material BP to the display output apparatus 30, thelistener terminals 70, or the like, based on details of detection of thegesture GT.

Note that the presentation material BP includes main material MP andsupplementary material SP. The main material MP is material that thepresenter PT mainly uses when giving a presentation. The supplementarymaterial SP is material that the presenter PT uses to supplement themain material MP, and is also called “additional material”.

FIG. 1 also shows an inside view of a meeting room MR, which is apresentation venue. The left side in FIG. 1 corresponds to the front ofthe meeting room MR, and the right side in FIG. 1 corresponds to theback of the meeting room MR. Listeners UA to UD are each seated in theback (right side in FIG. 1) of the meeting room MR and listen to thepresentation given by the presenter PT while looking toward a screen SC.The screen SC is set up in the forefront (left side in FIG. 1) of themeeting room MR, and an image output from the display output apparatus30 is projected on the screen SC. The presenter PT stands approximately1 to 2 meters back (toward the listener side) from and on the right sideof the screen SC when viewed from the listeners UA to UD and gives apresentation while looking toward either the screen SC or the listenersUA to UD. In short, the presenter PT gives a presentation in thevicinity of the screen SC.

The camera 20 is disposed at a position at which an image of thepresenter PT can be captured from the side of the presenter PT, andcaptures a moving image of the presenter PT.

The display output apparatus 30 is an apparatus that displays pageimages of presentation material. One example of the display outputapparatus 30 is a projector apparatus. Presentation listeners (i.e.,listeners UA, UB, UC, and UD) are able to visually recognize page imagesof the presentation material BP through the screen SC that is a displaysurface on which images output from the display output apparatus 30 aredisplayed.

Listener terminals 70A, 70B, 70C, and 70D are terminal apparatuses usedby the presentation listeners UA, UB, UC, and UD. One example of eachlistener terminal 70 that is used is a personal computer. The listenersUA to UD are each able to display and browse presentation material,using their listener terminals 70A to 70D.

In the present embodiment, the presentation apparatus 10 is configuredas an apparatus that also has an image forming function (image formingapparatus), and more specifically, as a Multi-Functional Peripheral(MFP).

FIG. 2 is a block diagram showing a schematic configuration of thepresentation apparatus (MFP) 10.

As shown in the functional block diagram of FIG. 2, the presentationapparatus (MFP) 10 includes, for example, an image reading unit 2, aprint output unit 3, a communication unit 4, a storage unit 5, aninput/output unit 6, and a controller 9, and realizes various functionsby causing these units to operate in combination.

The image reading unit (scanner unit) 2 is a processing unit thatgenerates image data (also called an “scanned image”) of an originaldocument placed on a predetermined position of the presentationapparatus (MFP) 10 through optical reading processing for opticallyreading the original document. For example, the image reading unit 2reads an original document placed on a predetermined position by thepresenter PT and generates image data of the original document as thepresentation material BP.

The print output unit 3 is an output unit that prints out an image onvarious media such as paper, based on data regarding an object to beprinted.

The communication unit 4 is a processing unit capable of networkcommunication via the communication network NW. This networkcommunication uses various protocols such as TCP/IP (transmissioncontrol protocol/Internet protocol) and FTP (file transfer protocol).Using the network communication enables the presentation apparatus (MFP)10 to exchange various types of data with the desired communicationpartner.

The storage unit 5 is configured by a storage device such as a hard diskdrive. The storage unit 5 stores, for example, the presentation materialBP generated by the image reading unit 2 and the like.

The input/output unit 6 includes an operation input unit 6 a thatreceives input to the presentation apparatus (MFP) 10 and a display unit6 b that displays and outputs various types of information.Specifically, the presentation apparatus 10 is provided with anoperation panel 63 (see FIG. 1) or the like. The operation panel (touchscreen) 63 is configured by embedding piezoelectric sensors or the likein a liquid crystal display panel, and functions as not only part of thedisplay unit 6 b and but also part of the operation input unit 6 a.

The controller 9 is a control apparatus that is built in thepresentation apparatus (MFP) 10 and performs overall control of thepresentation apparatus 10. The controller 9 is configured as a computersystem that includes, for example, a CPU and various types ofsemiconductor memories (such as a RAM and a ROM). The controller 9realizes various processing units by the CPU executing a predeterminedsoftware program (hereinafter, also referred to simply as a “program”)PG stored in a ROM (e.g., an EEPROM). Note that the program PG isrecorded on a portable recording medium such as a CD-ROM, a DVD-ROM, ora USB memory (in other words, various computer-readable non-transitoryrecording media) and is to be installed on the presentation apparatus 10via the recording medium.

To be more specific, the controller 9 includes a gesture detection unit91 and a distribution operation control unit 93 as shown in FIG. 2.

The gesture detection unit 91 is a processing unit that detects agesture (hereinafter also called a “gesture GT”) of the presenter PTbased on an image captured by the camera 20 or the like. As describedlater, the gesture detection unit, 91 starts detecting a gesture GT inresponse to a start instruction to start a presentation.

The distribution operation control unit 93 is a processing unit thatcontrols an operation for distributing the presentation material BPbased on the details of detection of the gesture GT.

2. Operations

Next is a description of various operations performed by thepresentation system 100.

In the presentation system 100, a presentation is started upon receiptof a start instruction from the presenter PT. Simultaneously with thestart of the presentation, the detection of a gesture GT of thepresenter PT based on an image captured by the camera 20 or the like isalso started.

When a gesture GT of the presenter PT has been detected after the startof the presentation, the presentation material BP is distributed to eachdistribution destination based on the details of detection of thegesture GT. When detecting a gesture GT, the orientation of the face ofthe presenter PT is also detected, and a distribution destination of thepresentation material BP is determined based on the orientation of theface.

Hereinafter, these operations will be described with reference to FIGS.3 to 24. To be specific, (1) the operation for registering thepresentation material BP, (2) the operation for starting a presentation,and (3) the operation for distributing the presentation material BP willbe each described in the order specified.

(1) The presentation material BP is registered in advance in thepresentation apparatus 10 by a host user (in the present example, thepresenter PT) before the start of a presentation. Below is a detaileddescription of the operation for registering the presentation materialBP with reference to FIGS. 3 to 6.

First, in accordance with a predetermined operation by the presenter PT,a screen GA1 (see FIG. 3) is displayed on the touch screen 63. As shownin FIG. 3, three buttons BT1, BT2, and BT3, each corresponding to adifferent category (namely, “Shared”, “Meeting”, or “Individual”), aredisplayed in the screen GA1. The present embodiment illustrates a casein which the presentation material BP or the like for the presentationis to be registered in a box BX2 corresponding to the category“Meeting”.

When the button BT2 has been pressed on the above screen GA1, anoperation screen GA2 (see FIG. 4) regarding the box BX2 is displayed onthe touch screen 63. As shown in FIG. 4, six buttons BT21 to BT26 thatcorrespond respectively to six boxes BX21 to BX26 are displayed inapproximately the center of the screen GA2. On the right side of thescreen GA2, buttons BN1 to BN3 for executing various operations aredisplayed. The button BN1 is a button for executing printing. The buttonBN2 is a button for giving an instruction to start a meeting(presentation). The button BN3 is a button for registering thepresentation material BP in the boxes BX21 to BX26.

This example shows a case in which the presentation material BP is to beregistered in the box BX21 corresponding to “Meeting 1”. First, when thebutton BT21 has been selected and the button BN3 has been pressed on thescreen GA2, the presentation apparatus 10 displays a screen GA3 (seeFIG. 5) on the touch screen 63. As shown in FIG. 5, a message reading“Main material is to be registered. Set main material on the documentplaten and press the start button.” is displayed in approximately thecenter of the screen GA3.

Here, when the original document of the main material MP has been set onthe document platen and the start button (not shown) has been pressed,the presentation apparatus 10 generates the main material MP by readingthe original document and stores the main material MP in the box BX21.When the main material MP has been stored, the presentation apparatus 10displays a screen GA4 (see FIG. 6) on the touch screen 63. As shown inFIG. 6, a message reading “Supplementary material is to be registered.Set supplementary material on the document platen and press the startbutton.” is displayed in approximately the center of the screen GA4.

Then, when the original document of the supplementary material SP hasbeen set on the document platen and the start button (not shown) hasbeen pressed, the presentation apparatus 10 generates the supplementarymaterial SP by reading the original document and stores thesupplementary material SP in the box BX21. When the supplementarymaterial SP has been stored, the presentation apparatus 10 displays, onthe touch screen 63, a display screen (not shown) for displaying amessage indicating that the main material MP and the supplementarymaterial SP have been registered in the box BX21.

Note that although the present example shows the case in which theoriginal documents are read by the image reading unit 2 and the mainmaterial SP and the supplementary material SP are generated andregistered in the box BX21, the present invention is not limited to thisexample. For example, a configuration is also possible in which variousfiles stored in an external apparatus are acquired as the main materialMP and the supplementary material SP via the network NW and stored inthe box BX21.

(2) Next, the operation for starting a presentation will be describedwith reference to FIG. 4.

First, the presenter PT causes the screen GA2 (see FIG. 4) to bedisplayed again on the touch screen 63 through a predeterminedoperation.

Thereafter, the presenter PT selects the button BT21 that corresponds tothe box BX21 in which the main material MP and the supplementarymaterial SP have been registered (stored) in advance, and presses thebutton BN2 for instructing the start of a presentation. The presentationapparatus 10 receives this operation of the presenter PT pressing thebutton BN2 as an instruction to start a presentation.

(3) Then, the operation for distributing the presentation material BPwill be described with reference to the flowcharts of FIGS. 7 to 9.

When the instruction to start the presentation has been received, instep S11 in FIG. 7, the presentation apparatus 10 distributes data ofthe main material MP (specifically, a page image of the first page ofthe main material MP) to the display output apparatus 30. The displayoutput apparatus 30 projects the distributed page image of the firstpage of the main material MP on the screen SC.

In step S12, the presentation apparatus 10 starts capturing an image ofthe presenter PT with the camera 20, and also starts detecting thegesture GT of the presenter PT, using the gesture detection unit 91. Inthis way, in response to the instruction to start a presentation, thegesture detection unit 91 starts detecting (monitoring) the gesture GTof the presenter PT.

Gestures GT1 to GT6 each consist of a common action CA in which thepresenter PT once raises an arm upward to a position higher than thatjust beside his/her face, and an action that follows the common actionCA and is unique to the gesture. Note that, in the present example, thecommon action CA is such that the presenter PT raises an arm with theelbow bent, and the elbow is still bent even when the arm has reachedthe position higher than that just beside the face. In other words, inthe common action CA, the arm of the presenter PT is not fully extended.When the action CA common to the gestures GT1 to GT6 has been detected,it is determined that the gesture GT (one of the gestures GT1 to GT6)has started. Furthermore, the type of the gesture (i.e., which one ofthe gestures GT1 to GT6 has been made) can be detected by also detectingdetails of the unique action following the common action CA.

To be more specific, as shown in FIG. 10, the presentation apparatus 10starts monitoring a surrounding area SA that includes the presenter PT,based on an image SG captured by the camera 20. During the monitoring ofthe surrounding area SA, the gesture detection unit 91 performs matchingprocessing between the image SG captured by the camera 20 and acomparative image HG (not shown) based on the image SG and thecomparative image HG. The comparative image HG is an image obtained bycapturing, in advance (before the start of the presentation), a state inwhich the presenter PT has raised an arm. For example, if an image SG1(see FIG. 11) captured at a certain point in time and the comparativeimage HG match during monitoring of the surrounding area SA, the gesturedetection unit 91 determines that the common action CA has been made. Atthe same time, the presentation apparatus 10 extracts the entire contourof the presenter PT from the captured image SG1 and further extracts anarm portion ST (see FIG. 11) of the presenter PT from the entirecontour. Specifically, the presentation apparatus 10 first extracts abody portion from the entire contour of the presenter PT and thenextracts a portion that projects (extends) upward (or diagonally upward)from the body portion as the arm portion ST (see FIG. 11) of thepresenter PT.

Furthermore, details of the action that follows the common action CA isalso detected together. Then, the fact that the gesture GT of thepresenter PT has been detected and the type of that gesture(specifically, one of the gestures GT1 to GT6) are determined based onthe common action and the action following the common action.

As will be described later, the gesture GT1 is a gesture in which thepresenter PT extends five fingers upward (raises all fingers) (see FIG.13), and the gesture GT2 is a gesture in which the presenter PT extends(raises) one finger upward (see FIG. 14). The gesture GT3 is a gesturein which the presenter PT extends (raises) three fingers upward (seeFIG. 15). Furthermore, the gesture GT4 is a gesture in which thepresenter PT who has raised the arm to beside the face moves that arm tothe right (see FIG. 17), and the gesture GT5 is a gesture in which thepresenter PT who has raised the arm to beside the face moves that arm tothe left (see FIG. 18). The gesture GT6 is a gesture in which thepresenter PT who has raised the arm to beside the face further moves,that arm upward (see FIG. 19).

It is, however, to be noted that as will be described later, thesegestures GT1 to GT6 are also distinguished by the detection result ofthe orientation of the face of the presenter PT when detecting thegesture. Specifically, the gestures GT1 to GT3 are detected on conditionthat the orientation of the face of the presenter PT is an “orientationD1”, which will be described later (steps S14 and S15). Furthermore, thegestures GT4 to GT6 are detected on condition that the orientation ofthe face of the presenter PT is an “orientation D2”, which will bedescribed later (steps S16 and S17).

In step S13 following step S12, it is determined whether or not thegesture GT of the presenter PT has been detected. If it has beendetermined that the gesture GT of the presenter PT has been detected,the procedure proceeds to step S14.

In step S14, it is determined whether or not the orientation of the faceof the presenter PT at the time of detection of the gesture GT is the“orientation D1”. Here, the orientation D1 is an orientation that isdirected from the position where the presenter PT is present toward thelisteners UA to UD, i.e., the “orientation toward the listeners”. Inother words, it is determined in step S14 whether or not the gesture GTof the presenter PT has been made toward the listeners UA to UD.

To be more specific, the presentation apparatus 10 performs matchingprocessing between the captured image SG1 (see FIG. 11) and acomparative image IG1 (not shown). Note that the comparative image IG1(not shown) is a still image obtained by the camera 20 capturing inadvance the presenter PT from the side in a state in which the presenterPT directs the face toward the seat positions of the listeners.

As a result of the matching between the captured image SG1 and the imageIG1, if it has been determined that the orientation of the face of thepresenter PT at the time of detection of the gesture GT is theorientation D1, the procedure proceeds to step S15. In step S15, theprocessing for distributing the presentation material BP to the listenerterminals 70 (see FIG. 8) is executed. Note that the processing fordistributing the presentation material BP to the listener terminals 70will be described later in detail.

On the other hand, as a result of the matching between the capturedimage SG1 and the image IG1, if it has been determined that theorientation of the face of the presenter PT at the time of detection ofthe gesture GT is not the orientation D1, the procedure proceeds to stepS16.

In step S16, it is determined whether or not the orientation of the faceof the presenter PT at the time of detection of the gesture GT is the“orientation D2”. Here, the orientation D2 is an orientation that isdirected from the position where the presenter PT is present toward thescreen SC, i.e., the “orientation toward the screen”. In other words, itis determined in step S16 whether or not the gesture GT of the presenterPT has been made toward the screen SC.

To be more specific, the presentation apparatus 10 performs matchingprocessing between the captured image SG1 (see FIG. 11) and acomparative image IG2 (not shown). Note that the comparative image IG2(not shown) is a still image obtained by the camera 20 capturing inadvance the presenter PT from the side in a state in which the presenterPT directs the face directed toward the screen SC.

As result of the matching between the captured image SG1 and the imageIG2, if it has been determined that the orientation of the face of thepresenter PT at the time of detection of the gesture GT is theorientation D2, the procedure proceeds to step S17. In step S17, theprocessing for distributing the presentation material BP to the displayoutput apparatus 30 (see FIG. 9) is executed. Note that the processingfor distributing the presentation material BP to the display outputapparatus 30 will also be described later in detail.

On the other hand, as a result of the matching between the capturedimage SG1 and the image IG2, if it has been determined that theorientation of the face at the time of detection of the gesture GT isnot the orientation D2, the procedure proceeds to step S18.

In step S18, it is determined whether or not to end the presentation. Ifit has been determined that the presentation is to end, the processingends, and otherwise the procedure returns to step S13.

Next, the processing for distributing the presentation material BP tothe listener terminals 70 (70A to 70D) (step S15 in FIG. 7) will bedescribed with reference to the flowchart of FIG. 8.

First, in step S51 in FIG. 8, it is determined whether or not the mainmaterial MP (specifically, a page image of the main material MP) isdisplayed on the screen SC. If it has been determined that the mainmaterial MP is displayed on the screen SC, the procedure proceeds tostep S52. If, on the other hand, it has been determined that the mainmaterial MP is not displayed on the screen SC, the processing shown inthe flowchart of FIG. 8 (processing of step S15 in FIG. 7) ends, and theprocedure proceeds to step S16 in FIG. 7.

In step S52, it is determined whether or not the presenter PT has made agesture GT in which he/she raises all fingers (hereinafter also referredto as the “gesture GT1”). To be more specific, whether or not thegesture GT1 has been made is determined by performing matchingprocessing between a partial image BG (see FIG. 12) and a comparativeimage JG1 (see FIG. 13). As shown in FIG. 12, the partial image BG is animage in the vicinity of the end of the arm, and more specifically, animage of a certain area around the end of the portion ST that extendsfrom the body of the presenter PT (e.g., an area of a circle having aradius of 15 cm in terms of the actual air clearance). Furthermore, thecomparative image JG1 is, as shown in FIG. 13, a still image obtained bycapturing in advance a state in which the presenter PT raises allfingers.

As a result of the matching between the partial image BG and thecomparative image JG1, if it has been determined that the gesture GT1has been made (the presenter PT is raising all fingers), the procedureproceeds to step S53. On the other hand, if it has been determined thatthe gesture GT1 has not been made, the procedure proceeds to step S54.

In step S53, the presentation apparatus 10 distributes the entirety ofthe main material MP (specifically, data of all pages of the mainmaterial MP) to the listener terminals 70 (70A to 70D). As a result, thelisteners UA to UD are able to appropriately browse all pages of themain material MP, using their listener terminals 70A to 70D.

In step S54, it is determined whether or not the presenter PT has made agesture GT in which he/she raises one finger (hereinafter also referredto as the “gesture GT2”). To be more specific, whether or not thegesture GT2 has been made is determined by performing matchingprocessing on the partial image BG (see FIG. 12) and a comparative imageJG2 (see FIG. 14). As shown in FIG. 14, the comparative image JG2 is animage obtained by capturing in advance a state in which the presenter PTis raising one finger.

As a result of the matching between the partial image BG and thecomparative image JG2, if it has been determined that the gesture GT2has been made (the presenter PT is raising one finger), the procedureproceeds to step S55. On the other hand, if it has been determined thatthe gesture GT2 has not been made, the procedure proceeds to step S56.

In step S55, the presentation apparatus 10 distributes part of the mainmaterial MP (specifically, from among a plurality of pages of the mainmaterial MP, data of a page that is displayed on the screen SC) to thelistener terminals 70 (70A to 70D). As a result, the listeners UA to UDare able to browse the page that is displayed on the screen SC, usingtheir listener terminals 70A to 70D.

In step S56, it is determined whether or not the presenter PT has made agesture GT in which he/she raises three fingers (hereinafter alsoreferred to as the “gesture GT3”). To be more specific, whether or notthe gesture GT3 has been made is determined by performing matchingprocessing between the partial image BG (see FIG. 12) and a comparativeimage JG3 (see FIG. 15). As shown in FIG. 15, the comparative image JG3is an image obtained by capturing in advance a state in which thepresenter PT is raising three fingers.

As a result of the matching between the partial image BG and thecomparative image JG3, if it has been determined that the gesture GT3has been made (the presenter PT is raising three fingers), the procedureproceeds to step S57. On the other hand, if it has been determined thatthe gesture GT3 has not been made, the processing shown in the flowchartof FIG. 8 (step S15 in FIG. 7) ends, and the procedure proceeds to stepS16 in FIG. 7.

In step S57, the presentation apparatus 10 distributes the entirety ofthe supplementary material SP (specifically, data of all pages of thesupplementary material SP) to the listener terminals 70 (70A to 70D). Asa result, the listeners UA to UD are able to appropriately browse allpages of the supplementary material SP, using their listener terminals70A to 70D.

Next, the processing for distributing the presentation material BP tothe display output apparatus 30 (step S17 in FIG. 7) will be describedwith reference to the flowchart of FIG. 9.

In step S71, it is determined whether or not the presenter PT has made agesture GT in which he/she who has raised the arm to beside the facemoves that arm to the right as shown in FIG. 17 (hereinafter alsoreferred to as the “gesture GT4”).

To be more specific, whether or not the gesture GT4 has been made isdetermined by comparing an image SG2 (see FIG. 16) and an image TG1 (seeFIG. 17). Note that the image SG2 is an image captured when thepresenter PT has made the common action CA. In this image SG2, theorientation of the face of the presenter PT is the orientation D2.Furthermore, the image TG1 is an image captured after a predeterminedperiod of time (e.g., 2 seconds) has elapsed after the image SG2 wascaptured.

Here, as shown in FIG. 17, when the arm position of the presenter PT inthe image TG1 is rightward (leftward in the image SG2) of the armposition of the presenter PT in the image SG2 as viewed from thepresenter PT, it is determined that the gesture GT4 has been made, andotherwise determined that the gesture GT4 has not been made. Note that,in the present example, the gesture GT4 is detected on condition thatthe orientation of the face of the presenter PT is the orientation D2.However, the present invention is not limited thereto, and the gestureGT4 may be detected without imposing the condition that the orientationof the face of the presenter PT is the orientation D2. To be morespecific, whether or not the gesture GT4 has been made may be determinedby just comparing the image SG2 and the image TG1, irrespective ofwhether or not the orientation of the face of the presenter PT is theorientation D2.

If it has been determined that the gesture GT4 has been made, theprocedure proceeds to step S72, in which data of a page NP next to thepage that is currently projected on the screen SC is distributed to thedisplay output apparatus 30, and a page image of the next page NP isprojected on the screen SC.

For example, a case is considered in which, when a page image of thesecond page of the main material MP is projected on the screen SC asshown in FIG. 20, it has been determined that the presenter PT has madethe gesture GT4. In this case, a page image of the third page, which isthe page NP next to the second page of the main material MP that iscurrently projected, is newly projected on the screen SC as shown inFIG. 21.

On the other hand, if it has been determined that the gesture GT4 hasnot been made, the procedure proceeds to step S73. In step S73, it isdetermined whether or not the presenter PT has made a gesture GT inwhich he/she who has raised the arm to beside the face moves that arm tothe left (hereinafter also referred to as the “gesture GT5”) (see FIG.18).

To be more specific, whether or not the gesture GT5 has been made isdetermined by comparing the image SG2 (see FIG. 16) and an image TG2(see FIG. 18). Note that the image TG2 is an image captured after apredetermined period of time (e.g., 2 seconds) has elapsed after theimage SG2 was captured.

Here, when the arm position of the presenter PT in the image TG2 isleftward (rightward in the image SG2) of the arm position of thepresenter PT in the image SG2 as viewed from the presenter PT as shownin FIG. 18, it is determined that the gesture GT5 has been made, andotherwise determined that the gesture GT5 has not been made.

If it has been determined that the gesture GT5 has been made, theprocedure proceeds to step S74, in which data of a page PP previous tothe page that is currently projected on the screen SC is distributed tothe display output apparatus 30, and a page image of the previous pagePP is projected on the screen SC.

For example, a case is considered in which, when the page image of thethird page of the main material MP is projected on the screen SC asshown in FIG. 21, it has been determined that the presenter PT had madethe gesture GT5. In this case, the page image of the second page, whichis the page previous to the third page of the main material MP that iscurrently projected, is newly projected on the screen SC as shown inFIG. 20.

On the other hand, if it has been determined that the gesture GT5 hasnot been made, the procedure proceeds to step S75.

In step S75, it is determined whether or not the presenter PT has made agesture GT in which he/she who has raised the arm to beside the facefurther raises that arm upward (hereinafter also referred to as the“gesture GT6”) (see FIG. 19).

To be more specific, whether or not the gesture GT6 has been made isdetermined by comparing the image SG2 (see FIG. 16) and an image TG3(see FIG. 19). As described above, the common action CA is an action inwhich the presenter PT raises an arm with the elbow bent to a positionhigher than that just beside the face. The gesture GT6 is an actionfollowing the common action CA, and specifically, an action in which thearm raised in the common action CA is further raised to a higherposition. The image SG2 is an image captured when the presenter PT hasmade the common action CA, and the image TG3 is an image captured aftera predetermined period of time (e.g., two seconds) has elapsed after theimage SG2 was captured.

If the arm position of the presenter PT in the image TG3 is furtherabove the arm position of the presenter PT in the image SG2 as shown inFIG. 19, it is determined that the gesture GT6 has been made, andotherwise determined that the gesture GT6 has not been made.

If it has been determined that the gesture GT6 has been made, theprocedure proceeds to step S76, and if it has been determined that thegesture GT6 has not been made, the processing shown in the flowchart ofFIG. 9 (processing of step S17 in FIG. 7) ends, and the procedureproceeds to step S18 in FIG. 7.

In step S76, an operation for switching the material to be displayed bythe display output apparatus 30 between the main material MP and thesupplementary material SP is performed. To be more specific, in the casewhere a page image of the main material MP is projected on the screenSC, a page image of the supplementary material SP is distributed to thedisplay output apparatus 30 and then projected on the screen SC.Conversely, in the case where a page image of the supplementary materialSP is projected on the screen SC, a page image of the main material MPis distributed to the display output apparatus 30 and then projected onthe screen SC.

For example, a case is considered in which the page image of the thirdpage of the main material MP is displayed on the screen SC as shown inFIG. 21. Here, if the presenter PT has made the gesture GT6 for thefirst time, a page image of the first page of the supplementary materialSP is distributed to the display output apparatus 30 and displayed onthe screen SC as shown in FIG. 22 (step S76 in FIG. 9).

Thereafter, if the presenter PT has made the gesture GT4 during displayof the page image of the first page of the supplementary material SP, apage image of the second page of the supplementary material SP isdistributed to the display output apparatus 30 and displayed on thescreen SC as shown in FIG. 23 (step S72 in FIG. 9).

Furthermore, if the presenter PT has made the gesture GT6 for the secondtime during display of the second page of the supplementary material SP,the page image of the third page of the main material MP, which wasdisplayed before the display of the supplementary material SP, isdistributed to the display output apparatus 30 and again displayed onthe screen SC as shown in FIG. 21.

Thereafter, if the presenter PT has made the gesture GT4 during displayof the third page of the main material MP, a page image of the fourthpage of the main material MP is distributed to the display outputapparatus 30 and displayed on the screen SC as shown in FIG. 24 (stepS72 in FIG. 9).

Furthermore, if the presenter PT has made the gesture GT6 for the thirdtime during display of the fourth page of the main material MP, the pageimage of the second page of the supplementary material SP, which wasdisplayed before the display of the main material MP, is distributed tothe display output apparatus 30 and again displayed on the screen SC asshown in FIG. 23 (step S76 in FIG. 9).

According to the operations described above, the detection of thegesture GT of the presenter PT is started in response to the instructionto start a presentation (step S12 in FIG. 7). Thus, it is possible toavoid a situation in which a gesture GT made before the start of thepresentation is erroneously detected.

Furthermore, the distribution destination of the presentation materialBP is determined based on the orientation of the face of the presenterPT at the time of detection of the gesture GT (see steps S14 and S16,for example). Thus, the presenter PT can easily determine thedistribution destination.

In particular, if it has been determined that the orientation of theface is the orientation D1 (orientation directed from the position wherethe presenter PT is present toward the listeners UA to UD), thedistribution destination of the presentation material BP is determinedto be the listener terminals 70A to 70D. In other words, the orientationof the face of the presenter PT (orientation D1) and the distributiondestination (listener terminals 70A to 70D) of the presentation materialBP are closely related to each other. Accordingly, it is possible forthe presenter PT to intuitively recognize the relationship between theorientation of the face when giving a gesture GT and the distributiondestination of the presentation material BP.

Similarly, if it has been determined that the orientation of the face isthe orientation D2 (orientation directed from the position where thepresenter PT is present toward the screen SC), the distributiondestination of the presentation material BP is determined to be thedisplay output apparatus 30. In other words, the orientation of the faceof the presenter PT (orientation D2) and the distribution destination ofthe presentation material BP (display output apparatus 30) are closelyrelated to each other. Accordingly, it is possible for the presenter PTto intuitively recognize the relationship between the orientation of theface when giving a gesture GT and the distribution destination of thepresentation material BP.

Furthermore, in the operations described above, the operation fordistributing the presentation material BP is controlled in accordancewith the gestures GT1 to GT6. It is thus possible for the presenter PTto instruct the distribution of the presentation material BP through asimple operation using the gestures GT1 to GT6.

To be more specific, whether all pages of the material to be distributedor part (single page) of the pages of the material to be distributed isto be used as a distribution target page is determined based on thedetails of detection of the gesture GT (specifically, whether thegesture GT1 or the gesture GT2 has been detected) (step S15).Accordingly, using the gestures GT1 and GT2 (specifically, selectivelyusing the two) allows the presenter PT to switch whether the entirety(all pages) of material (in the present example, the main material MP)specified from among the presentation material BP or part (single pagecurrently displayed) of the specified material is to be used as adistribution target page.

Furthermore, whether the main material MP or the supplementary materialSP is to be used as the material to be distributed is determined basedon the details of detection of the gesture GT (specifically, which oneof the gestures GT1, GT2, and GT3 has been detected). Accordingly, usingthe gestures GT1, GT2, and GT3 (selectively using the three) allows thepresenter PT to change which one of the main material MP and thesupplementary material SP is to be used as the material to bedistributed (e.g., the supplementary material SP).

In particular, by using the gesture GT3, the presenter PT can alsoinstruct to distribute, from among the main material MP and thesupplementary material SP, the entirety (all pages) of the material thatis not displayed (e.g., supplementary material SP), as the material tobe distributed.

Furthermore, the material to be distributed (in other words, thematerial to be displayed on the screen SC) is changed based on thedetails of detection of the gesture GT (specifically, the detection ofthe gesture GT6). Accordingly, by using the gesture GT6, the presenterPT can switch the material to be distributed, in other words, can switchbetween the main material MP and the supplementary material SP as thematerial to be displayed on the screen SC.

Moreover, whether the page PP previous to the page displayed on thescreen SC or the page NP next to the displayed page is to be used as thedistribution target page is determined based on the details of detectionof the gesture GT (specifically, which one of the gestures GT4 and GT5has been detected). Accordingly, using the gestures GT4 and GT5(selectively using the two) allows the presenter PT to instruct anoperation for changing the currently displayed page of the currentlydisplayed material (e.g., the main material MP) among the presentationmaterial BP.

Furthermore, in the above-described embodiment, the types of thegestures GT1 to GT6 are distinguished based on both the unique action(arm and/or finger action) following the common action CA and theorientation of the face of the presenter PT. It is thus possible toimprove the accuracy of distinction among the gestures GT1 to GT6 ascompared with the case where the above six types of gestures GT1 to GT6are distinguished without giving consideration to the orientation of theface.

3. Variations

While the above has been a description of an embodiment of the presentinvention, the present invention is not intended to be limited to thatdescribed above.

For example, while the above embodiment illustrates the case in whichthe presentation material BP is distributed to the listener terminals 70on condition that the main material MP is displayed, the presentinvention is not limited thereto, and a configuration is also possiblein which the presentation material BP is distributed to the listenerterminals 70 on condition that the supplementary material SP isdisplayed. Below is a detailed description of this variation withreference to FIG. 25.

According to this variation, step S15 in FIG. 25 is executed instead ofstep S15 in FIG. 8.

First, in step S91 in FIG. 25, it is determined whether or not thesupplementary material SP (specifically, a page image of thesupplementary material SP) is displayed on the screen SC. If it has beendetermined that the supplementary material SP is displayed on the screenSC, the procedure proceeds to step S92. On the other hand, if it hasbeen determined that the supplementary material SP is not displayed onthe screen SC, the processing shown in the flowchart of FIG. 25(processing of step S15 in FIG. 7) ends, and the procedure proceeds tostep S16 in FIG. 7.

In step S92, it is determined whether or not the gesture GT1 has beenmade. If it has been determined that the gesture GT1 has been made (thepresenter PT is raising all fingers), the procedure proceeds to stepS93. On the other hand, if it has been determined that the gesture GT1has not been made (the presenter PT is not raising all fingers), theprocedure proceeds to step S94.

In step S93, the presentation apparatus 10 distributes the entirety ofthe supplementary material SP (specifically, data of all pages of thesupplementary material SP) to the listener terminals 70 (70A to 70D). Asa result, the listeners UA to UD are able to appropriately browse allpages of the supplementary material SP, using their listener terminals70A to 70D.

In step S94, it is determined whether or not the gesture GT2 has beenmade. If it has been determined that the gesture GT2 has been made (thepresenter PT is raising one finger), the procedure proceeds to step S95.On the other hand, if it has been determined that the gesture GT2 hasnot been made (the presenter PT is not raising one finger), theprocedure proceeds to step S96.

In step S95, the presentation apparatus 10 distributes part of thesupplementary material SP (specifically, from among a plurality of pagesof the supplementary material SP, data of a page that is displayed onthe screen SC) to the listener terminals 70 (70A to 70D). As a result,the listeners UA to UD are able to browse the page of the supplementarymaterial SP that is displayed on the screen SC, using their listenerterminals 70A to 70D.

In step S96, it is determined whether or not the gesture GT3 has beenmade. If it has been determined that the gesture GT3 has been made (thepresenter PT is raising three fingers), the procedure proceeds to stepS97. On the other hand, if it has been determined that the gesture GT3has not been made (the presenter PT is not raising three fingers), theprocessing shown in the flowchart of FIG. 25 (step S15 in FIG. 7) ends,and the procedure proceeds to step S16 in FIG. 7.

In step S97, the presentation apparatus 10 distributes the entirety ofthe main material MP (specifically, data of all pages of the mainmaterial MP) to the listener terminals 70 (70A to 70D). As a result, thelisteners UA to UD are able to appropriately browse all pages of themain material MP, using their listener terminals 70A to 70D.

This variation (FIG. 25) illustrates the case in which the distributionoperations corresponding to the gestures GT1 to GT3 are performed oncondition that the supplementary material SP is displayed on the screenSC, whereas the above embodiment (FIG. 8) illustrates the case in whichthe distribution operations corresponding to the gestures GT1 to GT3 areperformed on condition that the main material MP is displayed on thescreen SC. However, the present invention is not limited to theseexamples, and a distribution operation in accordance with the type ofmaterial that is displayed on the screen SC may be performed in the casewhere either the supplementary material SP or the main material MP isdisplayed on the screen SC. In short, the operation of FIG. 25 and theoperation of FIG. 8 may be executed in combination.

More specifically, as shown in FIG. 26, when the gesture GT1 has beendetected, data of the entirety (all pages) of material that is displayedon the screen SC, from among the main material MP and the supplementarymaterial SP, may be distributed (step S103). Similarly, when the gestureGT2 has been detected, data of part (only the displayed page) of thematerial that is displayed on the screen SC, from among the mainmaterial MP and the supplementary material SP, may be distributed (stepS105). Furthermore, when the gesture GT3 has been detected, data of theentirety (all pages) of the other material that is different from thematerial being displayed on the screen SC (the main material MP or thesupplementary material SP) may be distributed (step S107). To be morespecific, a configuration is possible in which, when the gesture GT3 hasbeen detected, if the main material MP is displayed on the screen SC,data of the entirety (all pages) of the other material (i.e.,supplementary material SP) is distributed, and if the supplementarymaterial SP is displayed on the screen SC, data of the entirety (allpages) of the other material (i.e., main material MP) is distributed.

Furthermore, while the above embodiment and the like illustrate the casein which the gestures GT1 to GT6 are distinguished (identified) by alsogiving consideration to the orientation of the face of the presenter PT,the present invention is not limited to this example. For example, aplurality of gestures GT may be distinguished (identified) based on onlythe unique action (arm and/or finger action) following the common actionCA, without giving consideration to the orientation of the face of thepresenter PT. For example, the above plural types of gestures GT1 to GT6(or other plural types of gestures) may be distinguished from oneanother without giving consideration to the orientation of the face ofthe presenter PT. In this case, it is sufficient to distribute targetdata to a distribution destination that is predetermined per gesture.For example, the predetermined distribution destination for the gesturesGT1 to GT3 may be the listener terminals 70 (70A to 70D), and thepredetermined distribution destination for the gestures GT4 to GT6 maybe the display output apparatus 30.

Furthermore, while the above embodiment illustrates the case in whichthe type of the material to be distributed (the main material MP or thesupplementary material SP) and the distribution target page (all pagesor a single page) are changed in accordance with the type of the gestureGT, the present invention is not limited to this. For example, aconfiguration is possible in which predetermined data (e.g., data of thecurrently displayed page of the material that is displayed on the screenSC) is distributed when a single gesture GT10 (e.g., a gestureconsisting of only the common action CA) has been detected. Furthermore,in this case, the distribution destination may be changed in accordancewith the orientation of the face of the presenter PT when the gestureGT10 has been made, as in the above-described embodiment

The present invention may be embodied in various other forms withoutdeparting from the spirit or essential characteristics thereof. Theembodiments disclosed in this application are to be considered in allrespects as illustrative and not limiting. The scope of the invention isindicated by the appended claims rather than by the foregoingdescription, and all modifications or changes that come within themeaning and range of equivalency of the claims are intended to beembraced therein.

1. A presentation system comprising: a reception unit that receives astart instruction to start a presentation; a detection unit that startsdetecting a gesture of a presenter in response to the start instruction;and a control unit that controls an operation for distributingpresentation material, based on a detail of detection of the gesture. 2.The presentation system according to claim 1, wherein the detection unitfurther detects an orientation of a face of the presenter when detectingthe gesture, and the control unit determines a distribution destinationof the presentation material, based on the orientation of the face. 3.The presentation system according to claim 2, wherein the control unitdistributes the presentation material to a listener terminal oncondition that the orientation of the face is a first orientation thatis directed from a position where the presenter is present toward alistener, the listener terminal being a terminal of the listener.
 4. Thepresentation system according to claim 2, wherein the control unitdistributes the presentation material to a display output unit oncondition that the orientation of the face is a second orientation thatis directed from a position where the presenter is present toward adisplay surface on which an image output from the display output unit isdisplayed.
 5. The presentation system according to claim 1, wherein thecontrol unit determines material to be distributed, based on the detailof detection.
 6. The presentation system according to claim 5, whereinthe control unit determines whether main material or supplementarymaterial is to be used as the material to be distributed, based on thedetail of detection.
 7. The presentation system according to claim 1,wherein the control unit determines a distribution target page ofmaterial to be distributed, based on the detail of detection.
 8. Thepresentation system according to claim 7, wherein the control unitdetermines whether all pages of the material to be distributed or partof the pages of the material to be distributed is to be used as thedistribution target page, based on the detail of detection.
 9. Thepresentation system according to claim 7, wherein the control unitdetermines whether a page next to a page that is displayed on a displaysurface on which an image output from a display output unit isdisplayed, or a page previous to the page displayed on the displaysurface is to be used as the distribution target page, based on thedetail of detection.
 10. The presentation system according to claim 3,wherein on condition that a first gesture is detected by the detectionunit, the control unit distributes data of all pages of materialspecified from among the presentation material, to the listenerterminal.
 11. The presentation system according to claim 10, wherein thepresentation material includes main material and supplementary material,and in a case where the first gesture is detected, if the main materialis displayed on a display surface on which an image output from adisplay output unit is displayed, the control unit distributes data ofall pages of the main material to the listener terminal, and if thesupplementary material is displayed on the display surface, the controlunit distributes data of all pages of the supplementary material to thelistener terminal.
 12. The presentation system according to claim 3,wherein on condition that a second gesture is detected by the detectionunit, the control unit distributes, from among a plurality of pages ofthe presentation material, data of a page that is displayed on a displaysurface on which an image output from a display output unit isdisplayed, to the listener terminal.
 13. The presentation systemaccording to claim 12, wherein the presentation material includes mainmaterial and supplementary material, and in a case where the secondgesture is detected, if the main material is displayed on the displaysurface, the control unit distributes, from among a plurality of pagesof the main material, data of a page that is displayed on the displaysurface, to the listener terminal, and if the supplementary material isdisplayed on the display surface, the control unit distributes, fromamong a plurality of pages of the supplementary material, data of a pagethat is displayed on the display surface, to the listener terminal. 14.The presentation system according to claim 3, wherein the presentationmaterial includes main material and supplementary material, in a casewhere a third gesture is detected by the detection unit, if the mainmaterial is displayed on a display surface on which an image output froma display output unit is displayed, the control unit distributesentirety of the supplementary material to the listener terminal, and ifthe supplementary material is displayed on the display surface, thecontrol unit distributes entirety of the main material to the listenerterminal.
 15. The presentation system according to claim 4, wherein oncondition that a fourth gesture is detected by the detection unit, thecontrol unit distributes, from among a plurality of pages of thepresentation material, data of a page next to a page that is displayedon the display surface, to the display output unit.
 16. The presentationsystem according to claim 4, wherein on condition that a fifth gestureis detected by the detection unit, the control unit distributes, fromamong a plurality of pages of the presentation material, data of a pageprevious to a page that is displayed on the display surface, to thedisplay output unit.
 17. The presentation system according to claim 4,wherein the presentation material includes main material andsupplementary material, and in a case where a sixth gesture is detectedby the detection unit, if the main material is displayed on the displaysurface, the control unit distributes the supplementary material to thedisplay output unit, and if the supplementary material is displayed onthe display surface, the control unit distributes the main material tothe display output unit.
 18. A presentation system comprising: an imagecapturing apparatus for capturing an image of a presenter; and apresentation apparatus capable of communication with the image capturingapparatus, the presentation apparatus comprising: a reception unit thatreceives a start instruction to start a presentation; a detection unitthat detects a gesture of the presenter based on an image captured bythe image capturing apparatus; and a control unit that controls anoperation for distributing presentation material, based on a detail ofdetection of the gesture, wherein the detection unit starts detectingthe gesture in response to the start instruction.
 19. A presentationapparatus comprising: a reception unit that receives a start instructionto start a presentation; a detection unit that starts detecting agesture of a presenter in response to the start instruction; and acontrol unit that controls an operation for distributing presentationmaterial, based on a detail of detection of the gesture.
 20. Anon-transitory computer-readable recording medium that records a programfor causing a computer to execute the steps of: a) receiving a startinstruction to start a presentation; b) starting detecting a gesture ofa presenter in response to the start instruction; and c) distributingpresentation material based on a detail of detection of the gesture.